1803.04612v1 [cs.GR] 13 Mar 2018 


1V 


ar Xi 


d 


Procedural Planetary Multi-resolution Terrain Generation for Games 


Ricardo B. D. d'Oliveira* 


Antonio L. Apolinário Jr.* 


Federal University of Bahia, Brazil 


create & subdivide, 


@ 


‘control mesh 


zoom 1x 200m 2x 


tessellate tessollate further 


generate 
— 
heightmap control mesh 


displace 
oe 


IR 


zoom to surface 
details with noise 


Figure 1: Our proposal’s pipeline for procedurally generating multi-resolution terrains. 


ABSTRACT 


Terrains are the main part of an electronic game. To reduce hu- 
man effort on game development, procedural techniques are used 
to generate synthetic terrains. However rendering a terrain is not a 
trivial task. Their rendering techniques must be optimal for gam- 
ing. Specially planetary terrains, which must account for precision 
and scale conversion. Multi-resolution models are best fit to plan- 
etary terrains. An observer can change his point of view without 
noticing any decrease in visual quality. There are several proposals 
regarding real-time terrain rendering with multi-resolution models, 
and there are game engines capable of generating large scale ter- 
rains with fixed resolution. However for the best of our knowledge, 
it was noticed that there are no techniques which combine both as- 
pects. In this paper we present a new technique capable of generat- 
ing large-scale multi-resolution terrains, whichcan be rendered and 
viewed at different scales. Rendering large scale models with high 
definition and low scale areas with finer details added with the aid 
of procedural content generation. 


Keywords: Terrain Rendering, procedural terrain generation, tes- 
sellation, multi-resolution models. 


1 INTRODUCTION 


Computer gaming is increasingly present in our lives. Its develop- 
ment is a challenging task, considering its complexity and its assets 
[2]. Its assets can be comprised of graphical objects which usually 
have high definition models [2]. Manual modeling can be time con- 
suming depending on the desired quality [2]. Procedural content 
generation can be an alternative to manual content creation, it can 
randomize its output and reduce manual intervention [18]. Games 
benefit directly from procedural content generation, because tex- 
tures, audios and 3D models can be generated procedurally, with 
little to no human intervention [18]. 

PCG is widespread used in games, titles such as Spore [10], 
Torchlight [7], Diablo 3 [23] and No Man’s Sky [23] use PCG to 
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create 3D models, terrains, textures, scenarios, providing a unique 
experience in each playthrough. PCG removes the burden off game 
development, reducing its costs and its development time. The ear- 
liest use of PCG in eletronic games dates back to Elite’s approach 
on generating an universe [6], while the most outstanding can be 
considered the game .kkrieger [32] which is completely developed 
using PCG, grainy textures are created using Perlin Noise [29] and 
stored in memory, the terrain is deformed using midpoint displace- 
ment [15] and meshes are created from basic forms and then de- 
formed to a specific shape, resulting in a 97,280 bytes executable. 


Figure 2: Procedurally generated terrain using Blender. 


Virtual terrains, are game assets that, can be considered the main 
part of a game, because it is on the terrain where the game takes 
place [2]. A procedural method can be used to generate a terrain 
with a high visual quality, such as depicted in Figure 2. PCG can 
be used to generate vast [26] or infinite terrains [28]. O'Neil [26] 
adapted the ROAM terrain rendering algorithm [14] to tessellate a 
cube into an oblate sphere, applying a fractal algorithm to its sur- 
face, thus generating a planet. However O’Neil [26] demonstrated 
that using CPU terrain rendering techniques is not efficient, per- 
formance improvement could be achieved by using dedicated GPU 
techniques. Also, large terrains should be carefully dealt with to 
avoid precision errors [21]. 

A virtual terrain can be generated and rendered in different scale 
levels, there are several proposals regarding real-time terrain ren- 
dering with multi-resolution models, and there are game engines ca- 
pable of generating large scale terrains with fixed resolution. How- 
ever for the best of our knowledge, it was noticed that there are no 
techniques which combine both aspects. In this paper we present 
a new technique capable of generating large-scale multi-resolution 
terrains, which can be rendered and viewed at different scales, and 


at the lowest scale details are going to be added with PCG. 


2 Basic CONCEPTS 


DEM is a shorthand for Digital Elevation Model. It can be a textual 
or binary data representing a set of elevation samples [25]. Which 
in turn can be vector, such as Triangulated Irregular Grid — TIN, or 
raster. A raster DEM is known as heightmap, such a heightmap can 
be a greyscale image (Figure 4a). Where each pixel represents the 
elevation data if mapped correctly to a 3D grid mesh. 

Procedural content generation — PCG can be described as a se- 
rie of techniques that enable automatic content generation, random 
textures, 3d models and even audio can be created using PCG. 

The Programmable Graphics Pipeline — PGP is the way to ma- 
nipulate how a 3d scene is going to be rendered by coding each step 
of the graphics pipeline through shaders, shaders in turn are pieces 
of code than run directly into the GPU [16]. In this proposal we are 
discussing mainly both the Tessellation Shader — TS, which allows 
to refine simpler meshes into finer ones, and the Fragment Shader 
— FS, which is used to apply lighting, color blending, process and 
render a fragment, for example a pixel. 


3 RELATED WORK 


To represent scenes with large-scale models a vast amount of 
computational resources, such as RAM, CPU and GPU, must be 
present. Our approach tends toward gaming, thus those resources 
must be managed properly. There are two distinct approaches to 
manage these resources, either by using level of detail (LOD), 
specifically terrain rendering LOD techniques [31], or load balanc- 
ing, such as CPU-GPU coupled computation techniques [3]. LOD 
techniques were originally made for CPU, but as GPU became so- 
phisticated those techniques were implemented with TS. 

Terrain rendering is a well known research field among com- 
puter graphics, techniques such as ROAM [14] and BDAM [8] are 
prime examples of CPU terrain rendering with LOD, both use hi- 
erarchical binary trees (Figure 3a) to represent the terrain LOD. In 
contrast, more recent techniques such as [31], [13] and [34] have 
a GPU oriented approach, using quadtrees (Figure 3e) to represent 
the terrain LOD and using the PGP. 
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Figure 3: Adaptative meshes with control data structure, the upper 
part uses hierarchical bintrees, the lower part uses quadtrees. 


Terrain rendering algorithms can usually deal with vast terrains. 
But when it comes to planetary rendering adaptions must be made. 
In Cignoni et al. [9] the BDAM algorithm [8] is adapted and cou- 
pled with a out-of-core technique to deal with large data and tex- 
tures, being capable of rendering massive objects such as the planet 
Mars. O'Neil [26] is an adaptation of the ROAM algorithm is made 
to procedurally generating planets. That approach consists of cre- 
ating six terrains and interpolating them through a center of mass, 
generating a planetary body. Kooima et al. [21] proposes a GPU 


centred approach, employing general purpose GPU programming 
using little to no pre-processing, to render planetary terrains. 

Multi-resolution terrain rendering is accomplished by generating 
different mesh resolutions for each field of view, for example when 
viewing from the ground a terrain has a different resolution than 
viewed from space. While some LOD techniques can be applied to 
generate different terrain resolutions, finer details cannot be repre- 
sented or recovered. There are some approaches to circumvent this 
by either using TS [35] or by using multiple DEM [12]. 

Pajarola and Gobbetti [27] surveys on multi-resolution models 
for terrain rendering, comparing large scale terrain visualization 
techniques and their data structures. Pointing out that even though 
some of these techniques are simple to implement, they do not pro- 
vide full support on adaptive surfaces. Lindstrom and Cohen [24] 
proposes a on-the-fly decompression and rendering technique for 
multi-resolution where geometry is encoded through compression 
to be decompressed on the CPU or streamed for parallel decoding 
on the GPU. 


base mesh quadres 
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Figure 4: Terrain rendering graphics pipeline, the upper part runs 
on CPU while the lower runs on GPU. 


Generally speaking, current terrain rendering techniques use 
PGP, and their pipeline is similar to the one shown in the Figure 
4. Where a heightmap is read and stored as a texture, the quadtree 
is built following bottom-up strategy. In such way it can be decided 
that each leaf node has the highest possible LOD. Each node of 
the quadtree represents a patch. Each patch is passed to the Vertex 
Shader to be displaced accordingly to its respective coordinates in 
relation to the heightmap. In the TS the geometry can be refined 
depending on the desired LOD, while in the FS lightning and color 
blending can be applied. 

Terrain rendering techniques which use TS are more applicable 
in the context of this proposal, they are fair better at generating 
global features for a terrain [19]. Using TS a grid mesh can be 
smoothed, making it easier to add details, thus we can also explore 
LOD and multi-resolution approaches. 

While tessellating a mesh two issues can arise. If a patch is tes- 
sellated using a factor and it’s adjacent patch part isn’t tessellated 
or uses a lesser factor inconsistencies can appear. These inconsis- 
tencies are known as cracks (Figure 5a). The other issue revolves 
around the way LOD is managed, if LOD isn’t chosen properly or 
navigation speed is too fast visual inconsistencies can happen. Both 
Kim and Baek [20] and Song et al. [30] propose techniques for ter- 
rain rendering using TS. 

To resolve cracks, Kim and Baek [20] uses quadilateral patches 
(Figure 5a). Where both edges of the lower definition area, which 
are adjacent to the higher definition one, are bisected along with 
its largest edge, resulting in a mesh without any inconsistency left 
as shown in Figure 5b. Song et al. [30] algorithm uses tessella- 
tion control points, where its algorithm creates as many as needed 
points to represent a basic structure of geometry clipmaps. Instead 


(a) Mesh with two LOD patches. 


(b) Fixed mesh without cracks, 


Figure 5: To solve a crack after tesselating, a midpoint is added on 
the edges which are adjacent to the patch of higher definition. 


of creating alll vertices for a primitive, such as subdividing a base 
mesh with triangles, 

With a TS technique terrains of varying quality can be rendered, 
and if coupled with procedural terrain generation, not only a terrain 
can be generated, but details can be added. This is where TS come 
in, they provide ways to manage LOD and we can decide in which 
LOD finer details can be further added. Procedural Generation is 
usually correlated with fractal algorithms, [29] and [15] are the first 
proposal for terrain generation through fractals, and both argue that 
fractals are well suit for that task because they mimic natural events 
and its stochastic behavior. Fractal algorithms are usually described 
as noise algorithms [15][29][22]. While these techniques are rela- 
tively old, they are still used [4], because of their efficiency and 
simplicity. Perlin noise can generate content with natural looking 
and can be used to generate virtually any kind of media ranging 
from 2d objects such as textures and audios to 3d models [4]. Per- 
lin Noise is not restricted to content generation but it can be use 
for generic mesh refinement [5]. There are several Perlin noise im- 
plementations [22], among them there is [17], an implementation 
for generating fractal noises on the GPU, which is applicable to the 
context of this proposal. 

While Terrain with TS is well suit for global visualization. For 
instance, [33] is an implementation that generates terrain with Per- 
lin Noise, then the mesh output is tessellated according to the 
viewer distance, giving a terrain with high definition if the cam- 
era is close to the surface, and a rough and less detailed as a viewer 
looks into distance, this implementation follows a pipeline similar 
to the one depicted in Figure 4. 

Whereas PCG is adequated for adding finer details to a mesh, 
such as skin harshness, surface porosity or rugosity, among others. 
For example, a fractal noise can be generated on the FS, it then can 
be applied as a displacement map, creating a rough aspect on the 
mesh. This approach is used on [1]. It proposes a deterministic 
tiling strategy with fractal noise to achieve a specific level of detail. 
That approach is adequate to achieve our purpose. 


4 OUR PROPOSAL 


We propose a technique for generating multi-resolution terrains us- 
ing the PGP. The terrain generated from out method is going to 
have global features. While zoomed in, not only its geometry is 
going to be refined, but details are going to be introduced through 
fractal noise usage. To achieve that we are going to further analyze 
state-art methods and their algorithms. 

Multi-resolution terrain rendering with TS are going to be fur- 
ther analyzed. We are also going to do the same feat about PCG 
techniques suitable for generating terrains and details. Once that 
analysis is completed an adequate data structure for our proposed 
method must be either proposed or implemented. Then we are go- 
ing to generate a functional prototype to validate the proposed tech- 
nique. 

Our proposed technique must be coupled with the fact that plan- 
etary objects have specific ways to threat with model precision, 
view accuracy, horizon curvature representation, data dimension- 
ality [11]. Planetary renders usually deals with atmosphere rep- 


resentation. Our proposal does not focus on real-time atmosphere 
rendering, a basic implementation is going to be used [11]. The 
terrains generated with our proposed method must be comprised of 
high geometric details, its render must support and mix GPU tech- 
niques for refinement, subdivision and simplification, thus being 
capable of generating and rendering multi-resolution terrains with 
at least some realistic appeal. 

The algorithm of our proposal is subdivided into two main steps, 
the first part runs primarily on the CPU, while the later is executed 
on the GPU. It is going to be comprised of the following steps: On 
the CPU (i) a low quality planetary base grid mesh is going to be 
instantiated, (ii) the base grid mesh is going to be associated to a 
control mesh data structure. Then on the GPU (iii) a procedural 
heightmap is going to be generated (iv) the base grid mesh is going 
to be displaced accordingly to the heightmap in the Vertex Shader, 
(v) the base grid mesh geometry is going to be refined with TS based 
on visibility, (vi) the terrain is rasterized, (vii) once we have the ter- 
rain curvature, in the FS, lighting and color blending are going to be 
applied, (viii) the terrain is rendered, (ix) through user interaction 
the LOD is going to be dynamically applied, (vi.i) on another pass 
in the FS, if the terrain is zoomed in, details are going to be fur- 
ther added through the introduction of tiling refinement with fractal 
noise and displacement [1], (viii) if the terrain is zoomed out, the 
process renders a lower quality LOD mesh using the TS. The Fig- 
ure 1 depicts our proposal’s pipeline for procedurally generating 
planets and multi-resolution terrains. 

Our proposal aims to use methods which doesn’t require or deal 
with any pre-generated data. Our proposal does not want to only 
mix two distinct techniques, but we aim to turn terrain rendering 
with PCG more efficient and concise, fully exploring current hard- 
ware rendering capability, under the perspective of efficiency in al- 
gorithms and routines. Texturing terrains is not a trivial task, spe- 
cially for spherical surfaces. 

UV mapping comes as the de-facto way to texturize a terrain 
through polar coordinates. However using these approaches lead 
to incoherences. Planets are not perfect spheres, they tend to be 
oblate, thus using polar coordinates may show distortions on the 
poles and along the equator. The terrain textures we produce are 
going to be generated in the Shaders, it allows us to take advantage 
of three planar texturing, which is best suit for round objects. 

In the context of this proposal techniques for CPU-GPU coupled 
computation [3] and planetary scale composition [21] apply. They 
both guide exactly on what is required towards dealing with large 
data and specific configurations for planetary bodies. Due to its 
simplicity on dealing issues that arise with rendering terrains with 
TS, [30] is going to be the default way to manage LOD and tessel- 
lation, We are going to use both techniques proposed by [5] and 
[1] to add details to the highest LOD possible through noise and 
displacement mapping. 

It is worth to emphasize that high quality geometry generated 
with our proposed method resides on the GPU. Thus General Pur- 
pose GPU — GPGPU programming may be necessary to calculate 
collisions, to store a mesh or to retrieve the geometry for CPU pro- 
cessing. We are going to implement functional prototypes from 
our proposed method. We also are going to release our proposed 
method as a framework which can be integrated into game engines 
such as Unity or Unreal. We further aim to share its code to the 
open-source and scientific community for reviews and further col- 
laboration. 


5 CONCLUSION 


We presented our proposal for a multi-resolution technique terrain 
for games. We aim to make it possible combining two strategies 
with CPU large scale terrain rendering, and with GPU precise low 
scale terrain rendering. We are going to use PCG to both gener- 
ate those terrains and to add details on the highest possible LOD. 


Those details are going to be added on the FS. We are also going 
to use TS to manage and generate LOD on those terrains. To the 
best of our knowledge there is an existent technique which unified 
both the global and local aspects for rendering large terrains. Our 
next steps comprise of studying terrain rendering with TS imple- 
mentations and adapt them to usage with PCG. We are also going 
to face challenges related to planetary terrains. Once we overcome 
those challenges we intend to release a functional prototype to eval- 
uate our proposal, we also inted to share our technique as a library 
which may be integrated on known game engines. As technical im- 
provement we may research on using geometry shader to balance 
LOD control and GPGPU for refined mesh retrieval. 
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